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Abstract — Iterative decoding of non-binary LDPC codes is 
currently performed using either the Sum-Product or the Min- 
Sum algorithms or slightly different versions of them. In this 
paper, several low-complexity quasi-optimal iterative algorithms 
are proposed for decoding non-binary codes. The Min-Max 
algorithm is one of them and it has the benefit of two possible 
LLR domain implementations: a standard implementation, whose 
complexity scales as the square of the Galois field's cardinality 
and a reduced complexity implementation called selective imple- 
mentation, which makes the Min-Max decoding very attractive 
for practical purposes. 

Index Terms — LDPC codes, graph codes, iterative decoding. 



I. Introduction 

Although already proposed by Gallager in his PhD thesis 
[1], [2] the use of non binary LDPC codes is still very 
limited today, mainly because of the decoding complexity 
of these codes. The optimal iterative decoding is performed 
by the Sum-Product algorithm [3] at the price of an in- 
creased complexity, computation instability, and dependence 
on thermal noise estimation errors. The Min-Sum algorithm 
[3] performs a sub-optimal iterative decoding, less complex 
than the Sum-Product decoding, and independent of thermal 
noise estimation errors. The sub-optimality of the Min-Sum 
decoding comes from the overestimation of extrinsic messages 
computed within the check-node processing. 

The Sum-Product algorithm can be efficiently implemented 
in the probability domain using binary Fourier transforms 
[4] and its complexity is dominated by 0(<7log 2 q) sum and 
product operations for each check node processing, where 
q is the cardinality of the Galois field of the non-binary 
LDPC code. The Min-Sum decoding can be implemented 
either in the log-probability domain or in the log-likelihood 
ratio (LLR) domain and its complexity is dominated by 0(q 2 ) 
sum operations for each check node processing. In the LLR 
domain, a reduced selective implementation of the Min-Sum 
decoding, called Extended Min-Sum, was proposed in [5], [6]. 
Here "selective" means that the check-node processing uses 
the incoming messages concerning only a part of the Galois 
field elements. Non binary LDPC codes were also investigated 
in [7], [8], [9]. 

In this paper we propose several new algorithms for deco- 
ding non-binary LDPC codes, one of which is called the Min- 
Max algorithm. They are all independent of thermal noise esti- 
mation errors and perform quasi-optimal decoding - meaning 
that they present a very small performance loss with respect 
to the optimal iterative decoding (Sum-Product). We also 
propose two implementations of the Min-Max algorithm, both 

Part of this work was performed in the frame of the ICTNEWCOM++ 
project which is a partly EU funded Network of Excellence of the 7th 
European Framework Program. 



in the LLR domain, so that the decoding is computationally 
stable: a "standard implementation" whose complexity scales 
as the square of the Galois field's cardinality and a reduced 
complexity implementation called "selective implementation" . 
That makes the Min-Max decoding very attractive for practical 
purposes. 

The paper is organized as follows. In the next section we 
briefly review several realizations of the Min-Sum algorithm 
for non binary LDPC codes. It is intended to keep the 
paper self-contained but also to justify some of our choices 
regarding the new decoding algorithms introduced in section 
Hill The implementation of the Min-Max decoder is discussed 
in section HVl SectionlVlpresents simulation results and section 
[VI] concludes this paper. 

The following notations will be used throughout the paper. 

Notations related to the Galois field: 

• GV{q) — {0, 1, • • • , q — 1}, the Galois field with q elements, 
where q is a power of a prime number. Its elements will be 
called symbols, in order to be distinguished from ordinary 
integers. 

• a,s,x will be used to denote GF((?)-symbols. 

• €,s, x will be used to denote vectors of GF(q)-symbols. 
For instance, o = (ai, . . . , a/) G GF(g) / , etc. 

Notations related to LDPC codes: 

• He Mm,jv(gf(<z)), the q-ary check matrix of the code. 

• c €, set of codewords of the LDPC code. 

• ^i(a), set of codewords with the n* coordinate equal to 
a; for given 1 < n < N and a S G¥(q). 

• x = {x\, X2, ■ ■ ■ , %n) a q-ary codeword transmitted over 
the channel. 

The Tanner graph associated with an LDPC code consists 
of N variable nodes and M check nodes representing the N 
columns and the M lines of the matrix H. A variable node and 
a check node are connected by an edge if the corresponding 
element of matrix H is not zero. Each edge of the graph is 
labeled by the corresponding non zero element of H. 

Notations related to the Tanner graph: 

• H, the Tanner graph of the code. 

• n £ {1, 2, . . . , N} a variable node of Ti. 

• to G {1, 2, . . . , M} a check node of Ti. 

• H(n), set of neighbor check nodes of the variable node n. 

• H(m), set of neighbor variable nodes of the check node to. 

• _§f(m), set of local configurations verifying the check 
node to; i.e. the set of sequences of GF(g)-symbols 
id = (an)nen(m) > verifying the linear constraint: 

• Jzf (to I a n = a), set of local configurations a verifying to, 
such that a n — a; for given n G TL(m) and a G GF(g). 
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An iterative decoding algorithm consists of an initialization 
step followed by an iterative exchange of messages between 
variable and check nodes connected in the Tanner graph. 

Notations related to an iterative decoding algorithm: 

• 7„(a), the a priori information of the variable node n 
concerning the symbol a. 

• 7n(a), the a posteriori information of the variable node n 
concerning the symbol a. 

• CK m>I j(a), the message from the check node m to the 
variable node n concerning the symbol a. 

• Pm,n( a )i m e message from the variable node n to the check 
node m concerning the symbol a. 

II. Realizations of the Min-Sum decoding 

FOR NON BINARY LDPC CODES 

A. Min-Sum decoding 

The Min-Sum decoding is generally implemented in the log- 
probability domain and it performs the following operations: 

Initialization 

• A priori information: J n (a) = — In (Pr(x n = a | channel)) 

• Variable node messages: a„ ljn (a) — 7„(a) 

Iterations 

• Check node processing 



• Variable node processing 

a m ,n( a ) = 7«(a) 4 

• A posteriori information 



K n' GH(m)\{n} 



m'eH(n)\{m} 



7n(<z) = 7„(a) + 2^ P m .n(a) 

mGH(n) 

For practical purposes, messages a mtn (a) and j3 m . n (a) 
should be normalized in order to avoid computational insta- 
bility (otherwise they could "escape" to infinity). The check 
node processing, which dominates the decoding complexity, 
can be implemented using a forward - backward computation 
method. 

Assuming that the Tanner graph is cycle free, the a posteriori 
information converges after finitely many iterations to [3]: 



7n(a) 



min 



\k=l 



7fe(«fc) 



Moreover, if s n = argmin (7™ (a)) is the most likely symbol 

aeGF(g) 

according to the a posteriori information computed above, then 
the sequence s — (si, S2, ■ ■ ■ , sn) is a codeword (this is no 
longer true if the Tanner graph contains cycles) and it can be 
easily verified that s = argmax^,^ Pr = o | channel). 

Thus, under the cycle free assumption the Min-Sum decoding 
always outputs a codeword and the above equality looks 
rather like a maximum likelihood decoding, which is in 



contrast with the sub-optimality property. In [3], the author 
concludes that the Min-Sum decoding is optimal in terms of 
block error probability, but our explanation is quite different. 
What really happens is that probabilities from the above 
equality do not take into account the dependence relations 
between codeword's symbols (or equivalently between graph's 
variable nodes). Taking into account only the channel obser- 
vation and no prior information about dependence relations 
between codeword's symbols, we have Pr (x = « | channel) = 

N 

Y\_ Pr {x n — a n I channel), therefore even a sequence x which 

n=l 

is not a codeword has a non zero probability. In some sense, 
the Min-Sum decoding converges to a maximum likelihood de- 
coding, distorted by dependence relations between codeword's 
symbols. 



B. Equivalent iterative decoders 

The term of equivalent (iterative) decoders will be em- 
ployed several times through this paper. We begin this section 
by providing its rigorous definition. Consider the a posteriori 
information available at a variable node n after the I th decoding 
iteration: it defines an order between the symbols of the Galois 
field, starting with the most likely symbol and ending with 
the least likely one. Note that the most likely symbol may 
correspond to the minimum or to the maximum of the a 
posteriori information, depending on the decoding algorithm. 
We call this order the a posteriori order of variable node n at 
iteration /. 

We say that two decoders are equivalent if, for each variable 
node n, they both induce the same a posteriori order at any 
iteration I. In particular, assuming that the hard decoding 
corresponds to the most likely symbol, both decoders output 
the same sequence of GF(<7)-symbols. 

Two iterative decoders, which are equivalent to the Min- 
Sum decoder are presented below. 

1 ) Min-Sumo decoding: The Min-Sumo decoding performs 
the following operations. 

Initialization 

• A priori information^ 

7n(o) = In (Pr(a; n = | channel) /Pr(.T„ = a \ channel)) 

• Variable node messages: a m . n (a) = 7«(a) 
Iterations 

• Check node processing: same as for Min-Sum (III- Ab 

• Variable node processing 

«m,n( a ) = 7n0) + Pm',n{a) 
m'<£H(n)\{m} 

oc m , n (a) = a' (a) -a' (0) 



• A posteriori information: same as for Min-Sum (III-Ab 

We note that the exchanged messages represent log- 
likelihood ratios with respect to a fixed symbol (here, the 
symbol G GF(q) is used, but obviously other symbols may 
be considered). Its main advantage with respect to the classical 

'We assume that all codewords are sent equally likely. 
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Min-Sum decoding is that it is computationally stable, so that 
there is no need to normalize the exchanged messages. This 
algorithm is also known as the Extended Min-Sum algorithm 
[5], [6]. 

2) Min-Sum* decoding: The Min-Sum* decoding performs 
the following operations. 

Initialization 

• A priori information 

7n(«) = m (Pr(£n = s n | channel)/Pr(x„ = a | channel)) 

where s n is the most likely symbol for x n . 

• Variable node messages: a rn ^ n (a) = 7 n (&) 
Iterations 

• Check node processing: same as for Min-Sum (III-At 

• Variable node processing 

a ' m ,n(a) = 7n(o) + Pm'A a ) 
m'e"H(n)\{m} 

a 'm,n = ™n «m,n( a ) 
oeGF(g) 

dm,n{ a ) = a m,n( a ) ~ a m,n 

• A posteriori information: same as for Min-Sum (III-Ab 

As the Min-Sumo decoding, the Min-Sum* decoding also 
performs in the LLR domain and is computationally stable. 
The main difference is that the exchanged messages represent 
log-likelihood ratios with respect to the most likely symbol, 
which may vary from a variable node to another, or within a 
fixed variable node, from an iteration to the other. 

Theorem 1: The Min-Sum, Min-Sumo and Min-Sum* de- 
coders are equivalent. 

It follows that the Min-Sum* decoding does not present 
any practical interest: the equivalent Min-Sumo decoding is 
already computationally stable and less complex (it does not 
require the minimum computation in the variable node pro- 
cessing step). However, the Min-Sum* motivates the decoding 
algorithms that will be introduced in the following section. 
The fundamental observation is that messages concerning most 
likely symbols are always equal to zero, and messages con- 
cerning the other symbols are positive. Therefore, exchanged 
messages can be seen as metrics indicating how far is a given 
symbol from the most likely one. This will be developed in 
the next section. 

III. MlN-NORM DECODING FOR NON BINARY LDPC 
CODES 

According to the discussion in the above section, we inter- 
pret variable node messages as metrics indicating the distance 
between a given symbol and the most likely one. Consider 
a check node m and a variable node n £ H(m). Using 
the received extrinsic information, i.e. metrics received from 
variable nodes n' £ H(m) \ {n}, the check node m has to 
evaluate: 

• the most likely symbol for variable node n, 

• how far the other symbols are from the most likely one. 

To simplify notation, we set H(m) — {n, ni, . . . , n d } and 
let Si be the most likely symbols corresponding to variable 



node rii, i = l,...,d. Since the linear constraint corre- 
sponding to the check node m has to be satisfied, the most 
likely symbol for the variable node n is the unique symbol 
s G GF(q), such that: 

(s,Si, ...,Sd) G Jz?(m) 

On the other hand, each symbol a G GF(g) corresponds to a set 
of d-tuples (ai, • • ■ , ad), such that (a, a%, . . . , ad) G S£(m): 

Jz? a (m) = {(ai, ...,a d ) \ (a,ai, . ..,a d ) G 2£(m)} 

Thus, identifying s = (si, . . . ,s<j) and a = Jzf a (m), the 
distance between the most likely symbol s and the symbol a 
can be evaluated as the distance from the sequence (si , . . . , Sd) 
to the set Jz? a (m). As usual, we consider that the distance from 
a point to a set is equal to the minimum distance between the 
given point and the points of the given set. In addition, we 
have to specify a rule that computes the distance between two 
sequences (si, . . . , Sd) and (ai, . . . , a d ), taking into account 
the received "marginal distances" between Sj and <Zj's. This 
can be done by using the distance associated with one of the 
p-norms (p > 1), or the infinity (also called maximum) norm 
on an appropriate multidimensional vector space. Precisely : 

f3m,n( a ) = dist (( S ll • • • J S d), £a{m)) 

= min dist((si, . . . ,s d ), (ai, . . . ,a d )) 

(a 1 ,...,a d )£Ca.(m) 

= min || dist(si,Oi),...,dist(sd,ad) \\ p 

(a 1 ,...,a d )£C a (m) 

= min || ai(oi), . . . ,a d (a d ) || p 

(ai,...,a <J )e£ a (m) 

Note that for p = 1 we obtain the Min-Sum* decoding from 
the above section. Taking into account that: 

II 111 > II h > ••• > II IU 

it follows that using any of the || \\ p or || Hoc norms would 
reduce the value of check node messages, which is desi- 
rable, since these messages are actually overestimated by the 
Min-Sum* algorithm. One could think that the infinity norm 
would excessively reduce check node messages values, but 
this is not true. In fact, the distance between || ||i and the 
infinity norm is less than twice the distance between || ||i and 
the Euclidian (p = 2) norm. In practice, it turns out that the 
infinity norm induces a more accurate computation of check 
node messages than || ||i. 

We focus now on the Euclidean and the infinity norms. 
The derived decoding algorithms are called Euclidean deco- 
ding, respectively Min-Max decoding. They perform the same 
initialization step, variable nodes processing, and a posteriori 
information update as the Min-Sum* decoding; therefore only 
the check node processing step will be described below. 

A. Euclidean decoding 
• Check nodes processing 
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B. Min-Max decoding 

• Check nodes processing 

I3 m .„(a) = min ( max a m , n /(a n /)) 

("n')n'eW(m) V™' eH M \ <"> / 
GJ^(m\a n —a) 

Theorem 2: Over GF(2), any decoding algorithm using any 
one of the p-norms, with p > 1, or the infinity-norm is 
equivalent to the Min-Sum decoding. In particular, the Min- 
Sum, Min-Max, and Euclidian decodings are equivalent. 

IV. Implementation of the Min-Max decoder 

In this section we give details about the implementation 
of the check node processing within the Min-Max decoder. 
First, we give a standard implementation using a well-known 
forward-backward computation technique. Next, we show that 
the computations performed within the standard implementa- 
tion do not need to use the information concerning all symbols 
of the Galois field and, consequently, we derive the so-called 
selective implementation of the Min-Max decoder. 

A. Standard implementation of the Min-Max decoder 

Let m be a check node and H(m) = {n\, ■ ■ ■ , rid} be 
the set of variable nodes connected to m in the Tanner graph. 

We recursively define forward and backward metrics, 
(-Fi)»=i,d-i and respectively (B,)j = 2,d as follows: 

Forward metrics 

• Fi(a) = a mini (h^) ni a) 

• Fi(a)= min (max(F i _ 1 (a'),a m) „ i (a"))) 

«',«"eGF(,) 
a'+h m>ni a" —a 

Backward metrics 

• B d {a) = a rn , nd (h m ] nd a) 

• Bi(a) = min (max(B i+ i(a'),a m , ni (a"))) 

o',a»€GF(,) 
a' +h m ,n i a"— a 

Then check node messages can be computed as follows: 

• (3 m . ni (a) = B 2 {a) and (3 m ,n d (a) = F d -i{a) 

• Pm. n;(a)= min (max(.Fi_i(a'), B i+1 (a"))) 

.',«"£GF h ) 

B. Selective implementation of the Min-Max decoder 

In this section we focus on the building blocks of the 
standard implementation, which are min-max computations of 
the following type: 

f(a)= min (max(/V), /"(«"))) 

-'.."eGFw 
h'a'+h"a"=ha 

The computation of / requires 0(q 2 ) comparisons. Our goal is 
to reduce this complexity by reducing the number of symbols 
a' and a" involved in the min-max computation. We start with 
the following proposition. 

Proposition 3: Let A', A" C GF(g) be two subsets of the 
Galois field, such that card(A') +card(A") > g + 1. Then for 
any a £ GF(g), there exist a' £ A' and a" G A" such that: 

ha = h'a' + ti'a" 



Corollary 4: Let A', A" C GF(g) be such that the set 

{/V)l«'eA'}u{/V')l«"eA"} 

contains the g + 1 lowest values of the set 

{/V) I a' e GF(g)} U {/"(a") | a" e GF(g)} 
Then for any a £ GF(g) the following equality holds: 
f(a)= min (max(/'(a'), /"(«"))) 

h' a' +h" a" — ha 

Example 5: Assume that we have to compute the values of 
/ and the base Galois field is GF(8). We proceed as follows: 

• Determine the 9 smallest values between the 16 values 
of the set {/'(0), /'(l), . . . , /'(7), /"(0), f"(l), f"(7)}. 
Let us assume for instance that the 9 smallest values are 

{/'(l), /'(2), /'(3), /'(4), /'(6), /'(7), /"(O), f"(l), /"(5)}. 

• Set A' = {1, 2, 3, 4, 6, 7} and A" = {0, 1, 5}, then compute 
the values of / using only the symbols in A' and A". 

In this way the computation of the 8 values of / takes only 
6 x 3 = 18 comparisons instead of 64. 

In general, let q' = card(A') and q" = card(A"), where the 
subsets A' and A" are assumed to satisfy the conditions of the 
above corollary (then q' + q" > q + 1). If g' + q" = q + 1, then 
the complexity of the "min-max" computation can be reduced 
by at least a factor of four, from g 2 to g'g" < -(- + 1). 
The main problem we encounter is that we should sort the 
2g values of /' and /" in order to figure out which symbols 
participate in the sets A' and A". In order to avoid the sorting 
process, we generate the subsets: 

A^ = {a' £ GF(g) | L/>')J = k} 

A' fe ' = {a" £ GF(g) | lf"(a")\ = k} 

where [x\ denotes the integer part of x. We then define: 

A' = A' U • • • U A; and A" = Af,' U • • • U A? 

starting with t = and increasing its value until we get 
card(A') + card(A") > q + 1. 

The use of the sets A' and A" has a double interest: 

• it reduces the number of symbols required by (and then the 
complexity of) the min-max computation, 

• most of the maxima computations become obsolete. Indeed, 
max(/'(a'), f"(a")) is calculated only if symbols a' and a" 
belong to sets of the same index (i.e. a' £ A^/ and a" £ Afc» 
with k' = k"). Otherwise, the maximum corresponds to the 
symbol belonging to the set of maximal index. 

Finally, the proposed approach is carried out in practice as 
follows: 

• The received a priori information is normalized such that 
its average value is equal to a predefined constant AI (for 
"Average a priori Information"). This constant is chosen such 
that the integer part provides a sharp criterion to distinguish 
between the symbols of the Galois field, meaning that sets A' fe 
and A.^ only contain few elements. 

• We use a predefined threshold COT (for "Cut Off Thresh- 
old") representing the maximum value of variable node mes- 
sages. Thus, incoming variable node messages greater than or 
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Fig. 1. Decoding performance of GF(16)-LDPC codes, AWGN, 16-QAM, 
coding rate 1/2, maximum number of decoding iterations = 200 

equal to the predefined threshold will not participate in the 
min-max computations for check node processing. It follows 
that the rank k of subsets A' k and A.^ ranges from to COT — 1. 
In this case, the subsets A' k and A'£ may contain all together 
less than q+1 symbols, in which case the min-max complexity 
may be significantly reduced. In practice, this generally occurs 
during the last iterations, when decoding is quite advanced and 
doubts persist only about a reduced number of symbols. 

Constants AI and COT have to be determined by Monte 
Carlo simulation and they only depend on the cardinality of 
the Galois field. 

V. Simulation results 

We present Monte-Carlo simulation results for coding rate 
1/2 over the AWGN channel. Fig. Q]presents the performance 
of GF(16)-LDPC codes with the 16-QAM modulation (Galois 
field symbols are mapped to constellation symbols). We note 
that the Euclidian and the Min-Max (standard and selective 
implementations) algorithms achieve nearly the same decoding 
performance, and the gap to the Sum-Product decoding per- 
formance is only of 0.2 dB For the selective implementation 
we used constants AI = 12 and COT =31. 

Fig- 12 presents the decoding complexity in number of 
operations per decoded bit (all decoding iterations included) 
of the Min-Sum, the standard and the selective Min-Max 
decoders over GF(16). The Min-Sum and the standard Min- 
Max decoders perform nearly the same number of operations 
per iteration, but the second decoder has better performance 
and needs a smaller number of iterations to converge. On the 
contrary, the standard and the selective Min-Max decoders 
have the same performance and they perform the same number 
of decoding iterations. Simply, the selective decoder takes 
a smaller number of operations to perform each decoding 
iteration, which explains its lower complexity (by a factor of 
4 with respect to the standard implementation). 

VI. Conclusions 

We shown that the extrinsic messages exchanged within the 
Min-Sum decoding of non binary LDPC codes may be seen 
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Fig. 2. Decoding complexity of GF(16)-LDPC codes, AWGN, 16-QAM, 
coding rate 1/2, maximum number of decoding iterations = 200 

as metrics indicating the distance between a given symbol 
and the most likely one. By using appropriate metrics, we 
have derived several low-complexity quasi-optimal iterative 
algorithms for decoding non-binary codes. The Euclidian and 
the Min-Max algorithms are ones of them. Furthermore, we 
gave a canonical selective implementation of the Min-Max 
decoding, which reduces the number of operations taken to 
perform each decoding iteration, without any performance 
degradation. The quasi-optimal performance together with the 
low complexity make the Min-Max decoding very attractive 
for practical purposes. 
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Appendix I 

Alternative realizations of the Min-Sum 
algorithm 

In this section we introduce two alternative realizations, 
called Min-Sumo and Min-Sum*, of the Min-Sum algorithm. 
We prove that they are equivalent to the MSA algorithm of 
section and, over GF(2), the Min-Sum* is equivalent to the 
Min-Max algorithm. We assume that the Tanner graph 7i is 
cycle free thought this sectior@. 

Nevertheless, this assumption can be removed by replacing H with 
computation trees and "codewords" with "pseudo-codewords" 
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Notation. 

• n G j\f = {1, 2, . . . , N} a variable node of W. 
> m G M = {1, 2, . . . , M} a c/iec£ wocfe of H. 



We have to prove that, after finitely many iterations, the 
equality 7„(a) = /(a) holds. Since the Tanner graph H is 
cycle free, it can be seen as a tree graph rooted at n. Let 



. For each check node m G M and each sequence H (n) = {m 1 ,m 2 , . . . ,m d } and, for j = 1,2,..., d, let Hj 
(a„)nen(m) of GF(q)-symbols indexed by the set of be the sub-graph of H emanating from the check node mj, as 



variable nodes connected to m, we note: 

m ((°n)neW(m)) = X] ^"»,™ a « 

The sequence (a„)„ e - H ( m ) is said to satisfy the check 
node m if m((a n )„e«(m)) = 0. Thus 

m((a n ) neH{m) ) =0<=> {a n ) neH(m) G ^f(m) 

The Min-Sum decoding performs the following computa- 
tions: 

Initialization 

• A priori information 

1 ( = ^ ^ cnanne l observation) \ 

^ n \Pr(a; n = a | channel observation) / 

• Variable to check messages initialization 

a m ,n(a) = ln{a) 

Iterations 

• Check to variable messages 



/3 m ,n{ a ) = min 



EJz?(m|a^ = a) 

• Variable to check messages 

"«(«) = 7n(o) - 



n'en(m)\{n} 



^2 Pm>,n(a) 

aw(a) = a' mn (a)-a' mn (0) 
• A posteriori information 

ln{a)=ln{a)+ P™A a ) 

rnen(n) 

Theorem 6: The Min-Sum decoding converges after 
finitely many iterations to 

j n (a) = min V -f k (a k ) - min V Jk(a k ) 



•=(«1 «JV) , ,_ ,, 

a&C:a n =a k£J\J 



aeC:a| (1) =0 fc< ^ 



where Vn ^-= U m eH(n) H(m) is the set of variable nodes 
separated by at most 1 check node from n (including n). 

Proof: The proof is derived in same manner as that of 
theorem 3.1 in [3]. The critical point is that we have to control 
the effect of withdrawing the a m , n (0) message from all the 
others a m ^ n {a) messages. Fix a variable node n and let: 



f(a) = _ ( min ^ ^ 7fc( fl fc) 
f = 

« = (»lv 

aeC:a\ (1) 

f(a) = f(a)-f 



0=(a 1 Ojy) 

aeC:a n =a keX 

min V 7fe(a fe ) 

o = (ai,...,a N ) f—' 

aeC:a\ (1) =0 fe eAT 



represented below: 




Fig. 3. Graphical representation of sub-graphs Hj 

Let also Cj be the linear code corresponding to the sub-graph 
Hj U {n}. Since 7/c(0) = for any k = 1, . . . , N, we have 

d 

f = ^ fj, where fj = min ^ 7fc(a/c)- Therefore, 
J=1 a| H ° ( !5=o fee ^ 



/(") - : | ( min o > J! 7fe(afc) | - / 

" ( 



.7=1 \a n =akeT-lj 




Denoting g mj (a) = min ^ 7fc(afc) J - /j we get 

a n =a VfcG'Hj 



/(a) = 7n(a) +^2g mj {a) 

This formula has the same structure as the update rule of 
the a posteriori information 7„(a). It follows that the equality 
ln{a) = f(a) holds provided that (3 mj ,n{a) = g mj (a). Due 
to the symmetry of the situation it suffices to carry out the 
case j = 1. For this, let if (mi) = {n,ni,n,2, . . . , rid} and, 
for j = 1, 2, . . . , d, let Hij be the sub-graph of Hi emanating 
from the variable node nj, as represented below: 




Fig. 4. Graphical representation of subgraphs Hi j 
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Let also C\.j be the linear code corresponding to the sub-graph 
Hi j and define 



tj(a,j)= min ^ 7fc( a fc) ■ Tnen: 



min ( £ lk {a k )\ = ^ [ £^i) 

mi(a,fl],. . ..ad)— 



a„=a \keHi 



and 



/i = min ^ 7fc( fl fe)=X! min Y ^ fc ( afc ) 
n|if'(mi 1 )= feeWl i =1 a"=o \kenij 

4=1 

Therefore: 



n (a) = min V t,- (o 3 -) J- *4 (°) 

Co 1 ,...,o (J )eGF(e)<i 1 ' 
mi (a,ai , . . .,a^)— 



4=1 



min ^fe(%)-^-(0)) 

mi(a,ai,...,a [ j)-0 V 



Defining t = min V" 7 fc (a fc ) 
»l v (i)=0 \ fcew ^ 

fL( a i) = mi" Y] lk(a k ) - min V 7fc (a fc ) 

J aECi j ' ' "EC! j ^ ' 

= tj(aj) - 1 

and fnjiaj) = f' nj {aj) - /^(O) = %(oj) - t,(0) we get 



3m! (a) 



min E-M a J') 

i.-.»d)eOF(„)<i I 



mi{a,ai,...,a c ()— 



This formula has the same structure as the update rule of 
the check to variable messages /3 mi n (a). It follows that the 
equality /3 mi , n (a) = g mi (a) holds, provided that a murlj (a) = 
f nj (a). This derives from the fact that /„. (a) verifies the same 
update rule as a mi) „. (a) or, equivalently, /^ .(a) verifies the 
same update rule as a' mi n .(a). The proof can be proceeded 
in same manner as for f(a), and then will be omitted. 

This process is repeated recursively until the leaf variable 
nodes are reached. Finally, we remark that if rij where a leaf 
variable node, then f nj (aj) = ln 3 {aj) = a munj (aj) and so 
we are done. ■ 

The Min-Sum* decoding performs the following computa- 
tions: 

Initialization 

• A priori information 

'Pr(x n = s n | channel observation) \ 



7n(a) = In , , 
\ Pr(a;„ = a | channel observation) J 

where s n is the most likely symbol for x n . 



• Variable to check messages initialization 

a m .n{a) = ln(a) 

Iterations 

• Check to variable messages 



min 

£Jz? (m\a n — a) 



v n' eH(m)\{n} 



(On') 



• Variable to check messages 

«m,n( a ) = 7n(a)+ 

m'eH(n)\{m} 

min a! (a) 

&m,n( a ) = a m,n( a ) ~ a m,n 

• A posteriori information 

7n(a) = 7«( a ) + 



Pm' ,n (^) 



0m,n(a) 



Fixe a variable node n, note — Ti. \ ({n} U Ti.(n)) and 
let be the linear code associated with (when a node of 
Ti is removed we also remove all the edges that are incident to 
the node). With this notation we have the following theorem. 

Theorem 7: The Min-Sum* decoding converges after 
finitely many iterations to 



7n(ffl) = min ^ 7fc(afc) - min 

aGC:a„=a fe 6-™ Qe c 4 feeW 



E 7fc(afe) 



The proof can be derived in same manner os that of the above 
theorem, and then will be omitted. 

We also note that the convergence formula of the MSA 
decoder is (see theorem 3.1 in [3]): 



7n(«) 



min Y] 7fc(a fc ) 



OSC : a„=a fee - /v 



For each of the Min-Sum and Min-Sum^ decoders the conver- 
gence formula is obtained by withdrawing from the right hand 
side terrr0 of the above formula a term that is independent of 
a. Note also that similar formulas hold after any fixed number 
of iterations - to see this, it suffices to cut off the tree graph 
Ti at the appropriate depth. Therefore, we get the following: 
Corollary 8: The MSA, Min-Sum and Min-Sum* de- 
coders are equivalent. 

We prove now that the MSA and the MMA decoders are 
equivalent over GF(2) (in a similar maner can be proved that 
over GF(2) the MSA decoder is equivalent to any other Min- 
| ||p decoder.) 

Proof: Since MSA and Min-Sum* decoder are equivalent, 
it suffices to prove that Min-Sum* and MMA decoders are 
equivalent over GF(2). In this case, the variable to check 

3 Note also that the a priori informations 7 n («) are not computed in the 
same way for the three decoders but they only differ by a term independent 
of a. Thus, for the MSA decoder 7«(a) = — \n(Pi{x n = a)), for the 
Min-Sumo decoder 7n(o) = — \n(Pt(x n = a)) + ln(Pr(ic n = 0)) and for 
the Min-Sum* decoder 7n(a) = — ln(Pr(x n = a)) + ln(Pr(x n = s n )), all 
probabilities being conditioned by the channel observation. 



x 



messages a m . n (a) are non negative and they concern only two 
symbols a G {0, 1}. Moreover, for one of these symbols the 
corresponding variable to check message in zero (precisely, for 
the symbol realizing the minimum of {a^„(a),a = 0,1}). 
Fix a check node m, a variable node n and a symbol a G 
GF(2), and let (a„')«/e«(m)\{n}> such that m((a„/)„/, a) = 0, 
be the sequence realizing the minimum: 



mm 



Then, for the Min-Sum* decoder 

Pm.n(a) = ^ am,n'(«"') 

Suppose that there are two symbols, say a n > and a n > 2 , of the 
sequence (an')n'eA/"(m)\{n}) whose corresponding variable to 
check messages are not zero, i.e. a m>n i. (a n >. ) > 0, i — 1,2. 
Then, consider a new sequence (5n')«'eW(m)\{n}> sucn that 
a n i = a n i if n' ^ n\ and a n / = a n / + l mod 2. This sequence 
still satisfies the check m, i.e. m((a n i) n i , a) = and 

ri'GW(m)\{ri} n'e?<(m)\{»} 

as a m ,Ti'(fln') = < a„ hn '(a n '.), what contradicts the 
minimality of the sequence (a n ') n 'eH(m)\{n}- It follows that 
there is at mot one symbol a n i whose corresponding variable 
to check message a m ^ n >(a n ') 7^ 0. Consequently, the sequence 
(fln')n'£H(m)\{n} a ls° realizes the minimum 



min max a m ,n>{a n >) 

(»„»)»'EH (m ) \n'en(m)\{n} 
GJ^{rn\a n —a) 

so the update rules for check to variable messages computes 
the same messages for both decoders. ■ 

Appendix II 
Proof of Proposition^ 

Proof: Let a G GF(q). Consider the functions <p,ip : 
GF(q) — > GF(g), defined by <p(x) = ha + h'x, and ip(x) = 
h"x. Since tp, and ^ are injective, we have: 

card(</?(A')) + card(^(A")) = card(A') + card(A") > q + 1 

It follows that <p(A') n ip(A") ^ 0, so there are a' G A', and 
a" G A" such that 

v {a!) = ip(a") ha+h'a' = h" a" <S> a = h' 1 (ti a' +h"a") 



